Appl. No. 10/597,168 

Reply to Office Action of September 2, 2010 

Amendments to the Claims: 

This listing of claims will replace all prior versions, and listings, of claims in the 
application: 

Listing of Claims: 

Claims 1-33 (canceled). 

Claim 34 (new): An information retrieving system which retrieves information 
according to image data and moving image data, the information retrieving system comprising: 
a terminal unit having: 

image data obtaining means for obtaining image data and moving image data, and 
transmitting means for transmitting the image data and the moving image data obtained 
by the image data obtaining means to a communication network, and 
a server unit having: 

a first database in which retrievable recognizing image data is registered, 

a second database in which meta data corresponding to the recognizing image data 
registered in the first database is registered, 

a registering section that collects information broadcast on television broadcasts and 
information published on web sites and registers the information as the retrievable recognizing 
image data to the first database, and collects meta data corresponding to the recognizing image 
data registered in the first database and registers the meta data to the second database, 

receiving means for receiving the image data and the moving image data transmitted 
from the terminal unit through the network, 

a feature extracting section which extracts a feature of image data of which the image 
data and the moving image data received by the receiving means are broken down frame by 
frame, 

a feature comparing section which extracts a feature of the recognizing image data 
registered in the first database and compares the feature of the image data of which the image 
data and the moving image data are broken down frame by frame with a feature of the 
recognizing image data, 
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retrieving means for retrieving the recognizing image data having a high match rate to an 
image element of the image data from the first database according to a compared result by the 
feature comparing section, and 

meta data extracting means for extracting the meta data from the second database 
according to a retrieved result by the retrieving means, 

wherein the server unit allows the terminal unit to browse the meta data extracted by the 
meta data extracting means through the communication network. 

Claim 35 (new): The information retrieving system as set forth in claim 34, 
wherein the retrieving means calculates a score of the match rate to the recognizing 
image data according to the feature data of the image data transmitted from the terminal unit and 
retrieves the recognizing image data having the score which is a predetermined value or greater 
as image data having the high match rate, and 

wherein the retrieving means retrieves the recognizing image data included in individual 
pieces of the image data of which the image data and the moving image data are broken down 
frame by frame at a predetermined rate or greater as image data having the high match rate. 

Claim 36 (new): The information retrieving system as set forth in claim 35, 
wherein the server unit side obtains the feature data. 

Claim 37 (new): The information retrieving system as set forth in claim 35, 
wherein the terminal unit pre-obtains the feature data of each piece of the image data of 
which the image data and the moving image data obtained by the image data obtaining means are 
broken down frame by frame and causes the transmitting means to transmit the feature data as 
the image data. 

Claim 38 (new): The information retrieving system as set forth in claim 34, 
wherein the retrieving means retrieves the recognizing image data according to data 
including either gray-scaled data of each piece of the image data of which the image data and the 
moving image data obtained by the image data obtaining means are broken down frame by frame 
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or color information of each piece of the image data of which the image data and the moving 
image data obtained by the image data obtaining means are broken down frame by frame. 

Claim 39 (new): The information retrieving system as set forth in claim 34, 
wherein the retrieving means outputs retrieved results corresponding to a plurality of 
image elements included in each piece of the image data of which the image data and the moving 
image data received by the receiving means are broken down frame by frame, and 

wherein the meta data is extracted from the second database according to a retrieved 
result of a part of a plurality of image elements and other image elements of the plurality of 
image elements are retrieved from the first database according to the extracted meta data. 

Claim 40 (new): The information retrieving system as set forth in claim 39, 
wherein the retrieving means has a first recognizing means for recognizing a person, a 
second recognizing means for recognizing characters, and a third recognizing means for 
recognizing a shape other than the person and the characters, and 

wherein the first, second, and third recognizing means perform recognizing processes for 
each piece of the image data of which the image data and the moving image data are broken 
down frame by frame and retrieve the person, the characters, and the shape other than the person 
and the characters included in individual pieces of the image data of which the image data and 
the moving image data are broken down frame by frame as image elements from the recognizing 
image data. 

Claim 41 (new): The information retrieving system as set forth in claim 34, 
wherein the server unit transmits an address on the communication network for the meta 

data extracted by the meta data extracting means to the terminal unit and provides the meta data 

to the terminal unit on the communication network. 

Claim 42 (new): The information retrieving system as set forth in claim 34, 
wherein the server unit transmits the meta data extracted by the meta data extracting 
means to the terminal unit through the communication network. 
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Claim 43 (new): The information retrieving system as set forth in claim 34, 
wherein when the meta data is browsed on the terminal unit, an address on the 

communication network relating to the meta data is allowed to be accessed from the terminal 

unit. 

Claim 44 (new): The information retrieving system as set forth in claim 34, 
wherein the terminal unit is a portable telephone terminal having a camera function. 

Claim 45 (new): An information retrieving method of a retrieving unit which 
retrieves information according to image data and moving image data which a terminal unit 
obtains, the information retrieving method comprising steps of: 

causing the terminal unit to obtain the image data and the moving image data; 

causing the terminal unit to transmit the image data and the moving image data obtained 
at the image data obtaining step from the terminal unit to a communication network; 

causing the retrieving unit to receive the image data and the moving image data 
transmitted at the transmitting step through the network; 

causing the retrieving unit to collect information broadcast on television broadcasts and 
information published on web sites and register the information as retrievable recognizing image 
data to a first database, and collect meta data corresponding to the recognizing image data 
registered in the first database and register the meta data to a second database; 

causing the retrieving unit to extract a feature of image data of which the image data and 
the moving image data received at the receiving step are broken down frame by frame, extract a 
feature of the recognizing image data registered in the first database, and retrieve the recognizing 
image data having a high match rate to an image element of the image data from the first 
database in which retrievable recognizing image data is registered according to a compared result 
of a feature of each piece of the image data of which the image data and the moving image data 
are broken down frame by frame with a feature of the recognizing image data; and 

causing the retrieving unit to extract the meta data from the second database in which the 
meta data corresponding to the recognizing image data registered in the first database according 
to a retrieved result at the retrieving step, 
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wherein the retrieving unit allows the terminal unit to browse the meta data extracted at 
the meta data extracting step through the communication network. 

Claim 46 (new): An information retrieving unit which retrieves information 
according to image data, the information retrieving unit comprising: 

a first database in which retrievable recognizing image data is registered; 

a second database in which meta data corresponding to the recognizing image data 
registered to the first database is registered; 

a registering section that collects information broadcast on television broadcasts and 
information published on web sites and registers the information as the retrievable recognizing 
image data to the first database, and collects meta data corresponding to the recognizing image 
data registered in the first database and registers the meta data to the second database; 

receiving means for receiving image data and moving image data transmitted from a 
terminal unit through a communication network; 

a feature extracting section which extracts a feature of each piece of image data of which 
the image data and the moving image data received by the receiving means are broken down 
frame by frame; 

a feature comparing section which extracts a feature of the recognizing image data 
registered in the first database and compares the feature of the image data of which the image 
data and the moving image data are broken down frame by frame with the feature of the 
recognizing image data; 

retrieving means for retrieving the recognizing image data Jiaving a high match rate to an 
image element of the image data from the first database according to a compared result by the 
feature comparing section; and 

meta data extracting means for extracting the meta data from the second database 
according to a retrieved result by the retrieving means, 

wherein the terminal unit is allowed to browse the meta data extracted by the meta data 
extracting means through the communication network. 
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Claim 47 (new): An information retrieving method of a retrieving unit which 
retrieves information according to image data, the information retrieving method comprising the 
steps of: 

causing the retrieving unit to collect information broadcast on television broadcasts and 
information published on web sites and register the information as retrievable recognizing image 
data to a first database, and collect meta data corresponding to the recognizing image data 
registered in the first database and registers the meta data to a second database; 

causing the retrieving unit to receive image data and moving image data transmitted from 
a terminal unit through a communication network; 

causing the retrieving unit to extract a feature of image data of which the image data and 
the moving image data received at the receiving step are broken down frame by frame, extract a 
feature of the recognizing image data registered in the first database, and retrieve the recognizing 
image data having a high match rate to an image element of the image data from the first 
database in which the retrievable recognizing image data is registered according to a compared 
result of the feature of the image data of which the image data and the moving image data are 
broken down frame by frame with the feature of the recognizing image data; and 

causing the retrieving unit to extract the meta data from the second database in which the 
meta data corresponding to the recognizing image data registered in the first database according 
to a retrieved result at the retrieving step, 

wherein the retrieving unit allows the terminal unit to browse the meta data extracted at 
the meta data extracting step through the communication network. 

Claim 48 (new): A non-transitory recording medium storing an information 
retrieving program which causes a computer unit to execute an information retrieving method of 
retrieving information according to image data, the information retrieving method comprising the 
steps of: 

causing the retrieving unit to collect information broadcast on television broadcasts and 
information published on web sites and register the information as retrievable recognizing image 
data to -a first database, and collect meta data corresponding to the recognizing image data 
registered in the first database and registers the meta data to a second database; 
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causing the retrieving unit to receive image data and moving image data transmitted from 
a terminal unit through a communication network; 

causing the retrieving unit to extract a feature of image data of which the image data and 
the moving image data received at the receiving step are broken down frame by frame, extract a 
feature of the recognizing image data registered in the first database, and retrieve the recognizing 
image data having a high match rate to an image element of the image data from the first 
database in which the retrievable recognizing image data is registered according to a compared 
result of the feature of the image data of which the image data and the moving image data are 
broken down frame by frame with the feature of the recognizing image data; and 

causing the retrieving unit to extract the meta data from the second database in which the 
meta data corresponding to the recognizing image data registered in the first database according 
to a retrieved result at the retrieving step, 

wherein the retrieving unit allows the terminal unit to browse the meta data extracted at 
the meta data extracting step through the communication network. 



Claim 49 (new): An image recognizing unit which recognizes a predetermined 
shape from image data, comprising: 

a first database in which retrievable recognizing image data is registered; 

a second database in which meta data of the recognizing image data registered in the first 
database is registered; 

a registering section that collects information broadcast on television broadcasts and 
information published on web sites and registers the information as the retrievable recognizing 
image data to the first database, and collects the meta data corresponding to the recognizing 
image data registered in the first database and registers the meta data to the second database; 

a feature extracting section which extracts a feature of image data of which input image 
data and input moving image data are broken down frame by frame; 

a feature comparing section which extracts a feature of the recognizing image data 
registered in the first database and compares the feature of the image data of which the image 
data and the moving image data are broken down frame by frame with the feature of the 
recognizing image data; 
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retrieving means for retrieving the recognizing image data having a high match rate to an 
image element of the image data from the first database according to a compared result by the 
feature comparing section; and 

meta data extracting means for extracting the meta data from the second database 
according to a retrieved result by the retrieving means. 

Claim 50 (new): The image recognizing unit as set forth in claim 49, 
wherein the retrieving means calculates a score of a match rate to the recognizing image 
data according to feature data of the input image data and, retrieves the recognizing image data 
having the score which is a predetermined value or greater as the image data having the high 
match rate, and 

wherein the recognizing image data included in each piece of the image data of which the 
moving image data are broken down frame by frame at a predetermined rate or greater are the 
retrieved result corresponding to the moving image data. 

Claim 5 1 (new): The image recognizing unit as set forth in claim 49, 
wherein the retrieving means retrieves the recognizing image data according to data 
including either gray-scaled data of each piece of the image data of which the input image data 
and the moving image data are broken down frame by frame or color information of each piece 
of the image data of which the input image data and the moving image data are broken down 
frame by frame. 

Claim 52 (new): The image recognizing unit as set forth in claim 49, 

wherein the retrieving means outputs retrieved results corresponding to a plurality of 

image elements included in individual pieces of the image data of which the image data and the 

moving image data are broken down frame by frame, and 

wherein the meta data is extracted from the second database according to a retrieved 

result corresponding to a part of the plurality of image elements and other image elements of the 

plurality of image elements are retrieved from the first database according to the extracted meta 

data. 
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Claim 53 (new): The image recognizing unit as set forth in claim 52, 
wherein the retrieving means has a first recognizing means for recognizing a person, a 
second recognizing means for recognizing characters, and a third recognizing means for 
recognizing a shape other than the person and the characters, and 

wherein the first, second, and third recognizing means perform recognizing processes for 
each piece of the image data of which the image data and the moving image data are broken 
down frame by frame and retrieve the person, the characters, and the shape other than the person 
and the characters included in individual pieces of the image data of which the image data and 
the moving image data are broken down frame by frame as the image elements from the 
recognizing image data. 

Claim 54 (new): The image recognizing unit as set forth in claim 52, 
wherein the meta data is extracted from the second database according to the retrieved 
result corresponding to the part of the plurality of image elements included in individual pieces 
of the image data of which the image data and the moving image data are broken down frame by 
frame and the other image elements of the plurality of image elements are retrieved from the first 
database according to the extracted meta data. 

Claim 55 (new): An image recognizing method of recognizing a predetermined 
shape from image data, the image recognizing method comprising the steps of: 

causing a retrieving unit to collect information broadcast on television broadcasts and 
information published on web sites and register the information as retrievable recognizing image 
data to a first database, and collect meta data corresponding to the recognizing image data 
registered in the first database and register the meta data to a second database; 

causing the retrieving unit to extract a feature of image data of which input image data 
and input moving image data are broken down frame by frame, extract a feature of the 
recognizing image data registered in the first database, and retrieve the recognizing image data 
having a high match rate to an image element of the image data from the first database in which 
the retrievable recognizing image data is registered according to a compared result of the feature 
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of the image data of which the image data and the moving image data are broken down frame by 
frame with the feature of the recognizing image data; and 

causing the retrieving unit to extract the meta data from the second database in which the 
meta data of the recognizing image data registered in the first database is registered according to 
a retrieved result at the retrieving step. 

Claim 56 (new): A non-transitory recording medium storing an image recognizing 
program which causes a computer unit to execute an image recognizing method of recognizing a 
predetermined shape from image data, the image recognizing method comprising the steps of: 

causing a retrieving unit to collect information broadcast on television broadcasts and 
information published on web sites and register the information as retrievable recognizing image 
data to a first database, and collect meta data corresponding to the recognizing image data 
registered in the first database and register the meta data to a second database; 

, causing the retrieving unit to extract a feature of image data of which input image data 
and input moving image data are broken down frame by frame, extract a feature of the 
recognizing image data registered in the first database, and retrieve the recognizing image data 
having a high match rate to an image element of the image data from the first database in which 
the retrievable recognizing image data is registered according to a compared result of the feature 
of the image data of which the image data and the moving image data are broken down frame by 
frame with the feature of the recognizing image data; and 

causing the retrieving unit to extract the meta data from the second database in which the 
meta data of the recognizing image data registered in the first database is registered according to 
a retrieved result at the retrieving step. 



1 1 



